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ABSTRACT 

This report- illustrates procedures of item 
construction for addition and subtraction examples involving decimal 
fractions. Using a procedural network of skills required to solve 
such examples, an. item characteristic matrix' of skills analysis fo* 
developed to describe the characteristics of the content domain by 
projected' student difficulties. Then 24- item tests Were constructed 
for addition and subtraction with decimals. Pre- and posttest ? 
versions of' each were administered to more than 100 junior high 
school students. After the pretest, each student was provided with 
some remediation geared to the particular "bugs" (persistent errors); 
then the posttest was given. A prediction of item dominance based on 
test characteristics is compared with item dominance determined from 
an item relational structure analysis of the data/ (MNS) 
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Abstract . 

, 'This .technical report illustrates a procedural networky-of skills 
needed to. solve problems^* involving the addition and subtraction of 
decimal fractions. The network is use^d to define an item characteristic 
matrix of skills analysis which Is then used as the basis for 

u 

constructing error diagnostic tests. Several examples of student 
response patteras are wed to illustrate the construction of a few 
selected items so that a test will have both content ana construct* 
alidity;.. ^ 

The report includes lists cf projected errors which are predicted 

from the nodes of the procedural network or from "the content domain 

.■J * 

relative skills analysis. A prediction of item dominance based on test 
characteristics is compared with item' dominance determined from an item 
relational structure (IRS) analysi^ of pr$-and post^tests administered to 
more than lOCt junior high school students. y 

The report includes the rprocedu^al networks content domain relative 
skills analysis, and complete tests for both addition arid subtraction. 
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Introduction 

The assessment, of student achievement and the diagnosis of student 
learning difficulties require, the use of tests which have both content 
' validity and construct validity. In order to determine uniquely student 
"bugs" (assuming there are such errors), test items must be selected tb 
reflect the underlyingvcognitive process used by most 'students. Error 
diagnostic tests for whole number subtraction (Brown <* Bur ton, ^78) and 
for signed-number arithmetic (Tatsuoka, Birenbaum', Tatsuoka, & Baiilie 
1980) have reported the successful diagnosis of hundreds cf erroneous 
rules of computation. > r 

This report illustrates procedures of item fconstruction for ad-^ 
dftion^and subtraction problems involving decimal fractions. First -we 
describe a procedural network .of skills that are required to solve , 
decimal fraction arithmetic problems'. Using that network, we develop 
an item characteristic matrix of skills analysis that describes the 
cnaracteristics of the content domain (decimal arithmetic) by projected 
student difficulties. Both the network and the content domain relative 
skills analysis are used to describe the construction of a 24-itera" 
addition test and a 24-ifem subtraction test (Appendix I). The content 
domain relative skills analysis is used to predict item dominances tor 
both addition and subtraction of" decimals. Also, the analysis was used 
to predict relative problem difficulty among all items. Actual item 
dominances and relative item difficulties were determined usin fe item 
relational structure analysis (Tatsuoka and Tatsuoka, 1981). 

Pre- and posttest versions of each were administered to more than 
100 junior high school students over a period of two weeks. . After pre- 
tests were scored, each student was provided with some remediation 
geared to. the particular "bugs" and to the student's prior knowledge of 
detimjl fraction arithmetic (self reported). Posttests were then 
administered., Although' we did not have^control over several variables 
such as prior knowledge or method of prior instruction, we can use ,the 
results- to s.uggest approaches to the construction of error-diagnostic 
tests and the remediation of student difficulties — particularly those 
which can be implemented as part of computerized adaptive testing- 
systems which can be used in the- classroom. Our suggestions and 
concerns are based on the test results, item dominance predictors, and 
interviews with students who missed more than 15% of the items. 



**■ Student "Bugs" in Decimal. Addition 

The content domain of decimal fraction arithmetic is an appropriate 
one for investigating initial efforts to computerize diagnostic tests 
and remediation in that the number of student "bugs" is considerably 
more limited than either signed-nuwber or fractions arithmetid. for 
this Study we projected nine erroneous rules which are peculiar to 
decimal fraction addition and eleven for decimal fraction subtraction. 

(We did not include erroneous rules which also belong to signed-nutaber 

i 

arithmetic^) On the other hand, 88 erroneous rules ^ere projected tor 
fraction arithmetic (Klein, Birenbaum, Snandiford, and Tatsuoka, 1981). 
The use of decimal fraction arithmetic is also more convenient in th^t s 
there are few problem types for which application of a ."bug" results in 
a correct answer. ** « 

As with other error diagnostic tests, the diagnosis of student 
difficulties and the assessment of student achievement requires more 
than a single raw score, s A uch as. percentage -of correct ituns* It is 
possible for several students to have identical scores yet\ave different 
degrees of seriousness of error r ouch as persistence or resistance to 
remediation (Birenbaum/& Tatsuoka, 1981; Klein, et al . , 1981). 1 , 

To illustrate, we have constructed answers to selected decimal 
addition and decimal subtraction problems using "bugs" consistently 
applied by junior high school students. On the addition "test" students 
1 and 2 have the same percentage correct. Both have a single "bug." 
Student 3, who has a higher correct percentage, h^s two "bugs."' 

I 

* Insert Table 1 about here 

O' 

Student 1 applies the "multiplication" rule to determine the number 
of decimal places in the. sum. Problems are set up correctly but the 
decimal point in the sum is located by adding the number of decimal 
places in the two addends. The only correctly answered items are those 
involving whole numbers. . * 

Studeut 2 applies the "right justification" rule in setting up the 
problem. The addends are written so that the digits are aligned along 
the right hand edge. The decimal is usually placed in the answer 
matching the addend with the greater number of digits to the right of 

" • 2, ^ 
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Table 1 
Decimal Addition Test • 



Item 


Student Answers 


•1 


*? 

L 


#1 

J 


.8 ♦ = l.H 


.11 K 


1-1 


.1H If 


.23 ♦ .5 = .73 


.073 K 


'' .28 X 


1 .73 


V 3.2 ■ 7.2 


7.2 


3.6 Hi- 


3.E X 




i * 

! 


i 




0.83 ♦ 0.5 = 1.33 


.133 X 


.88 li 


1.33 • 


PERCENT CORRECT 


. 25 Z 


2S2 


SO 2 



I 



X incorrect response 



3 

8 



I 

/ the decimal. The only correctly answered items are those whose addends 
have the same number of digits to^the right ojt the decimal. 

Student 3 has two "bugs." The 'first is the "carry rule" applied to 
problems whose sum of/ the tenth's place is greater than tme. The "1" 
carry is written to the right of the decimal # point only if the addends 
do not haye an explicit whole number digit. Thus the student 
fails to answer .6 + .8 but correctly deals with 0.83 + 0.5. The second 
bug is the "whole number" errot'in which numbers with no explicit • 
decimal points are aligned along th^ right edge.. 

^ * 

Insert Table 2 about here * 

/ 

The subtraction test illustrates tfcree different student "bugs" 
which result, in this case, in identical t$»t scores. Student 1. equates 
"more digits" with "larger number" which is always 0 written as the 

0 

minuend. Also, the^ student right justifies the numbers. The decimal 
point in the difference reflects the placement in the stifdent's "minuend." 

StudeQ^t 2 "brings down" numbers in the subtrahend ,if there are no 
corresponding digits in the minuend. This may be a carry over from 
addition thinking that there is "nothing to do." This will bef correct 
when the minuend is longer (i.e., there are no corresponding digits 
in the subtrahend) • 

Student 3 borrows correctly except, across thfe decimal point. In 
those problems the student merely adds ten 'to. the tenth's place without 
adjusting the units digit. 
Problem TyRes ' * , 

v Problem types were classified according to three attributes: 
number type, representation, and complexity. Number type was either 
whole number (W) or decimal fraction (D). Representations included 
implicit decimals (e.g., 3) or explicit decimal (e.g., 14.); leading 
zeros, (e.g., 0.53) or trailing zeros (e.g., 6.30). Complexity included 
carrying or borrowing (especially "across the decimal point"). 

If we consider whole numbers (W) with implicit decimal points (Wj) 
and explic:t decimal points j(W e ) and decimal fractions (D) we can 
identify nine addition problem types: W E + W E , Wj + Wj, W E + Wj, 
»I + W E» W E + D, D + W E ., W x + D, D + W If and D + D. 
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Table 2 



decimal Subtraction Test 



Item 

I 

( 


Student finswers 




; *2 


*3 


-H - .236 = .-16M 


.232 X 


.236 X 


-16H 


H.0§~- .68 = 3.37 


c 

3.37? > 


3.37 


H.37X 4 


l.Z - .367 ='3.833 


.325 X 


3.967 X 


H.833 X 


6.23 - H = 2.23* 


2.23 


2.23 , 


2.23' 


PERCENT CORRECT 


50 2 


50 2 


50 2 



H i correct response 




+ W^anc 



Since addition is commutative, three pairs are identical'; + W^and 
Wj + W E ; W E + D and D + W E ; iand, W : + D and D + W x . 

In addition to the combinations of number types, we considered 
representation and complexity. In an effort to -keep the decimal tests 
to a reasonable length, we limited our initial test items to problem 
types Wi + D (or D + Mj) and D + D but included various combinations of 



representation and complexity 
combinations of critical attr 



This limited domain allowed us to test 
.butes of problem types as well as 
* attributes related to procedure (see next section,) 

Nine different types of subtraction were also identitied: Wg - W^, 
W E - Wj, W X - H If W X - W E , W E t 0, D - W £ , «! - 0, D - «!, D - D. 
Since subtraction Is nit cummutative, all problem types are different. 
As in the addition tesk, problems involving W E were not included on the 
test administered during\:his stage of th^investigation. Also, problem 
type W x - Wj was not included as representative of a decimal test. 
Finally, care was taken to avoid problems which would yield a negative 
answer* 

The Procedural Network 

There are several different methods for adding or Subtracting 
decimals. The procedural Me two rk is a representation of different 
algorithms whcb, can be used to solve different types of problems. 
Figures 1 and 2 are procedural networks for addition and subtraction 
respectively. »- ^ 



Insert Figure 1 about here * 

i ■ — ± 

Insert Figure 2 about here 

\ 

Five sided cells indicate that the particular step in a procedure 
which is explained" in another chart. .The number of the chart is 
included in the cell label.. 

Using the* procedural networks,. we can classify the student errors 
as either "set up** or "decimal placement" errors. Set up errors occur 
when the student rewrites a horizontal addition (subtraction) problem as 
a vertical addition (subtraction) problem: * Errors such as "right- 
justification," "inside out justif icatTOn," apid "whole number errors" 

i i i » V 



. / 



ADDITION OF TWO DECIMALS I CHART t 



-a It. 



RECOGNIZE 
PROBLEM 
TYPE 



6 



RIGHT JUSTIFY , 
AOOENOS 



v 



W e +W E 



w e + o 



0 -KO 



Wj+O 



REWRITE IN VERTICAL FORMAT. 
ALIGN DECIMAL POINTS IN ADDENDS. 
RIGHT JUSTIFY WHOLE NUMBER PORTIONS. 
LEFT JUSTIFY OECIMAL PORTIONS. 



SDPPLY ZEROS TO 
"EMPTY" COLUMN PLACES 




SUPPLY OECIMAL PO'NT 
TO RIGHT OF Wi : 
W r => W E 



REWRITE IN VERTICAL 
FORMAT. RIGHT JUSTIFY 
WHOLE NUMBER PORTIONS. 



BRING 
DECIMA! 


DOWN 
L. POINT 




r • 


ADO COLUMNS ^ 
• ( CHART 3 ) , 



AOO COLUMNS 
( CHART ti) 



. BRING DOWN 
OECIMAL POINT 



Pi 



I 



■ sri 

.:i 

. J 
Jul 



ARE THERE 
EMgTY SPACES BETWEEN* - 
OKlflAL POINT AND NUMERALS 

to the sight of the 
decimal'point? 



NO 



YES 



SUPPLY ZEROS 

TO EMPTV 
COLUMN S PACES 



DONE 



FIGURE I : A Procedurol Network for Adding Two Decimal Fractions 
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12 

£ _ / 



TO SUBTRACT TWO DECIMALS * CHART 2 


• 


< 


* 

f 




* 


RECOGNIZE 
PROBLEM 
TYPE 





W t -Wi 









-W|. 







RIGHT JUSTIFY 
MINUENO AND « 
SUBTRAHEND 



W E -D 



D-D 



D-W r 



Wi-D 



\ 



PLACE SUBTRAHEND UNDER MINUEN($ 

ALIGN DECIMAL POINTS. 
RIGHT JUSTIFY WHOLE NUMBER PORTIONS. 
LEFT JUSTIFY DECIMAL PORTIONS. 



DOES 
MINUEND HAVE^ 
FEWER PLACES TO 
RIGHT OF "DECIMAL THAN 
SUBTRAHEND 
.? 



NO 



YES- 



© 



WRITE DECIMAL 'POINT 
TO RfiSHT OF WHOLE -. 

number: w t =>w e 



SUPPLY ZEROS SO THAT 
DECIMAL PORTIONS OF 
MlhAJEND AND SUBTRAH- 
END ARE SAME LENGTH. 



RIGHT JUSTIFY WHOLE 
NUMBER PORTIONS OF 
M WJEND AND SUBTRAHEND. 

~ w 



BRING DOWN 
DECIMAL: POINT. 



SUBTRACT COLUMN 
(CHART 4) 



SUBTRACT COLUMN 
( CHART 4 ) 



5> 



BRING DOWN 
DECIMAL POINT. 



ARE THERE 
"EMPTY SPACES BETWEEN* 
DECIMAL POINT AND NUMERALS. 
TO THE RIGHT OF THE 
DECIMAL POINT 
? 

NO! 



SUPPLY ZEROS 

TO EMPTY 
COLUMN SPACES. 



DONE 



FIGURE 2 : A Procedural Network for Subtracting Two Decimal Fractions. 
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fall into this category. Decimal placement errors occur in placing trie 
decimal in the sum* Errors such as "carry errors," or "multiplication 
rule" belong to. this category. 

One of the" purposes of this-study was to investigate the 
\ relationship be tweeft^ problem type attributes and the incideuce of 
certain procedural errdrs. • For example, do leading zeros in addends 
diminish the Inci^etice of "carry, errors?" 

Levels of Competency, . « 

Computation ; witJv decimals can be represent^d^flf^ skills hierarchy 
for addingr^'ubtracti^g). decimals. Using a skills hierarchy, several 
levels of competency >i|Seded _o solve addition and. subtraction problems 
can be idenfcITie<L " - .?* 

Level Q. The student understands the relationship between whole 
numbers and decimal fractions. The general concept of decimals is 
understood. 

Level I. The student is able to add (subtract) numbers with 
explicit decimals with the same number of digits to ri^lft of the decimal 
point. 

Level II, The student is able to add (subtract) numbers with 
explicit decimals with different numbers of .digits to right of decimal 
point. F^ure at* this level may be due to incorrect alignment of 
addends due to different lengths. 

Level III. The student is able to add (subtract) numbers with 
^licit decimals. Failure at this level -may be due to incorrect 

alignment of addends due to unwritten decimals.** * 

x 

Level IV. The student is able to add (subtract) numbers involving 
carrying (borrowing) to (from) the whole number portion of the addend 
(minuend). 

*' ? 

Level V. The student is able to add (subtract) involving several * 
problem types. 

Level 0 mastery indicates conceptual understanding of dec^als. Levels 
I - V x:an be achieved by adhering to a "recipe" or procedure for solving 
the particular problem. It is likely that students can "master" levels 
I -V without a clear understanding of level 0. Our test's were 
designed to test mastery of the procedural skills (levels I - V;. 
Mastery of level 0 was to be determined through interviews with 
individual students. 
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Procedures of Item Construction 
A common error in adding two fractions is a "carry error" in which 
the student does not carry a sum "across the decimal point." For 
example, for the item .8 + .6 the student might write .14 as the answer. 
There are two possible explanations for this error: the "carry error" 
0£ the placing the decimal point according to the rule for 

iplication. To determine which rule is being used, a sec6nd item 
such as .82 + .73, is needed. If the student answers .155 (carry error) 
or .0155 (multiplication rule) the rule is diagnosed. It may be, 
however, the student applies a particular rule only in certain problems. 
For example, the student may not use the "carry error" if tnere is a 
non-zero whole number digit in either addend. 

One way to approach itemfconst ruction to help identify possible 
contexts in which errors always (oryiever) occur is to construct a table 
indicating item characteristic by relative level of skill required 
to correctly answer the item. Such a table for addition is shown in 
Table 3. . 



Insert Table 3 about here 



Problem types can be identified from a content aoiaaiA relative 
skills matrix, characteristic table* Particular items can be 
constructed to match the combinations selected. For example \ an item 
such as .63 + 0.4 would reflect the following combinations: 



1. 


Problem form % \ 




Horizontal 


2. 


t&intfer of digits right of d.p. 




Different 
Explicit 


3. 


Decimal point 




4. 


■ Carry across zero 


s, 


Yes. X 


5,. 


Leading zero in addend 




Yes (one) 


6. 


' Embedded zeros in answer 


<* 


Yes ' 


7. 


Number of decimal places 




Different 


It 


should be noted that not all item 


characteristic selections are 



independent. For example "implicit decimal" indicates one addend is a 
whole number. As a result, "number of digits* to right of dp" must be 
different,* and "number of decimal place% in answer" must be equal to sum 
of decimal places in the 'addends. This is not to say, however, that 

ERIC * ♦ 



V 



r 
}. 

\ Table 3: 




< 




Characteristics of the Content Domain 
Difficulties in Decimal Fraction Addit 


by Projected 
ion Problems 

-i 


I 




RELATIVE SKILL LEVEL REQUIRED 


ITBn CHflRRCTERISTIC 


* 


EASY . MODERATE 

• 


DIFFICULT 


Problem Form 




t 


\ 


Format 




^^Vertical 


1 

Horizontal 


Number digits 
right of d.p. 
in addends 




* Equal Different 
(and equal (and unequal 
addend lengths) addend lengths) 

m 


Di f ferent 
(and equal 
addend lmfM 


Decimal notation 




Explicit 

* • 


Tmol ici i" 


Complexity 




* 




Carry across 
decimal point 




No 


Yes 


Leading zeros 






No 


Answer Form 




> 


> 


Embedded Zeros 




None y(few) ^ 




Number of decimal 
places in answer 
c/w sum oCplaces 
in addends 

: eye \ 




?qual 

* 

■ 16 . . 


Di f ferent 




e 

r 





artudent bugs* related to these categories are not possible. To 
illustrate, the item 7 + .4 might be 'interpreted as: 





»4 


•4 , 1 


.4 


" .4 




,7 


_7 


> 7 


.7 






r.i 


.11 


.11 


possible 


whole 


mult, rule 


carry 


carry* 


errors 


number 


Afhole /lumber 


right just. 


mult, rule 






right just. 


whole number 


whole number 


Finally, 


to reduce 


the number of problems 


to test likely student bugs, 



we did not construct items for 1 two categories: problem form "vertical 1 
and whole number "explicit ^decimal." 

This table can be used to predict item "difficulty" which ^fn be 
tested experimentally. Table 4 shows the 7 analysis for the first 12 
addition problems (the second 12 are parallel items). ' 

Insert Table 4 about here 
Based on this analyfcip, items with characteristics matching "easy" 
should, in fact, be answered correctly more often than items with 
characteristics matching' "difficult." One would predict the f ollowipg * 
dominances: v 

1,2 < 7,8,9*11 

4 < 7,11 

% 9 < 8 • 

10 < 5,6,8,12 , 

IS there is an interaction between certain characteristic^, such as 
"carry" and "leading zeros" then one would predict the following 
domif 



Ln^nces: 



1,2 < 9,8 

i 4 < 7,11- 

9 < 8 5 

10 < ,5,6,8,12 



If one were to give equal weights to the independent * 

characteristics "digits", "notation", and "embed", and weigh "carry" 

when "leading zeros" would influence its application, one would predict 

the following relative item difficulties for addition: 

1,2,3,4 easiest 

10 easy * 

6,7,9,11 difficult , 

5,8,12 most difficult 1 

A similar technique is used for subtraction problems. The item 

12 17 



j Table 4W. ; 

Judged Rating for SKILL X ITEM CHflRfiCTERISTIC Interaction 

J Addition Test 



Item 

Decimal 
notation 



iracteristic 



Carry 
across 

d.p. . 
(note 4) 




Lead 
Zero 



D 
D 



M 
D 
D 

D 



Embed Answer 
answer decimal 

zero places 
(note 5)* (note 6) 



E 
E 
E 
E 
E 
E 
E 
D 
D 
E 
E 
E 



T 



D 

D u 

D 

D 

E 

D 

D 

D 

D 

D 

D ' 

E 



note: 1 right justification error 

2 insi de-outs ide justification 

3 -» whole number ' 

4 -» carry across zero 

5 ■+ missing zero 

6 multiplication rule 



13 

13 



\ ■ 

r 

^characteristic x skill table "shown in table 5* The table showing the 
analysis for the first 1*2 (of 24) subtraction proble&s :ts presented in 
table 6* 4 
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Insert 


Table* 5 about 


here 




Insert 


Table 6 about 


here 



Using the anal/sis in tatJie 6, one would predict the following 
dominances : 

5 < 2,12 

11 < 4 
6,8,10 < 7 < 3 < 9 

1 < 4,9 

12 < 9 

, » 

-If one were to give equal weights to * the '.independent 

characteristics "digits", "notation", "multiple borrows", "borrow across 

zero", and "fractional part of subtrahend greater than tira ;ional part 

of minuend," one would predict t^he following relative item difficulties 

in subtraction: • - % 

5 easiest 
6,8,10,2 easy 
-1,7,11,12 neutral 

3,9 ( difficult 
. 4 most difficult ' , 

T est Results 

The pre- and posttests for addition and subtraction were .analyzed 
to determine iteni dominance using* techniques discussed in detail in 
Tatsuoka and Tatsuoka (1981). The dominance relationships among all 
items on the addition pre- and posttests are illustrated in figures 3 
and 4. * 



Insert Figure 3 about here 

i 

Insert Kigure 4 about he re 

These figures indicate that problems with little inherent 

u . 13 



i ! y 


1 » 

t 
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| Table 5: Characteristics^ the Content Domain by Projected 
| Difficulties in Decimal Subtract ion Problems 


1. 

|tEM •tfHflRflCTERISTIC 


Relative skill level required v 


EflSY 


M0OPW7E 


DIFFICULT 

/ 


§? • 

Problem Form 








If 

If- Format 

* 


Vertical 




Horizontal 


f Number digits 
right of d.p. 
0 *<M) c/w *(S) 

3* 

t Decimal notation 


*(M) = ♦(S) 
Expl icit 


*(M) >*(S) 


*(M) < *(S) 
Impl icit 


Complexity 








5 0 Borrow across 
decimal pjpint 


^fk> 
(no borrows) 


(few borrows) / - 


(many borrows) 


Trail ing zeros 
Answer Form 


Yes 

(and * 0D >* (S) ) 


Yes 

(and * OD <* (S) ) 


No 

(and *(M)<*(S): 


Embedded Zeros 


None (few) 




Some (many) 


Number qf decimal 
places in answer 
c/w sum of places 
in Min. and Subt. 


\ Equal 


ft 

20 . 


Di f ferent 



Table 6 



Judged Rating for SKILL x ITEM CHflRflCTERISTIC Interact! on v 

Subtraction Test ' ■ 



Item Characteristic 



• 


Digits 


Decimal 


Borrow 


Borrow 


Digits' in Subt. 




rt. of * 


notation 


across 


oyer 2 


less than 


Itesn 


A rv 


i 


d.p. 


digits 


number in Min. 


(nt. 1,2) 


(note 3) 


(note. 4) 




(notes 5,6) 


14:25-3.4 


D 


E 


*D 


r 

E 




1.4-.8 


E 


E 


D 


. E 




6*4-3.235 


D 


E 




D 


\ I 


6-3.8 


D 


D 


D 


E . 




.035-. 01 4 


E 


E 


E 


E * 




.456^0.31 


D 


E 


E 


E 


. E 


6.35-3.248 


D 


E 


E 


E 


D 


.576-. 23 


D 


E 


, E 


E 


' E 


2F.fg4-H.03 


D 


E 


D 


D 


E 


.631-. 3108 


D 


E 


E 


E 


E 


8.7-5 


D 


D 


E 


E 


E 


4. 0*2-. 081 


E 


E 


D 

« 


D 


E 

. k 



note: 



1 

2 
3 
4 
5 
6 



right justification 

ihsi de-outs ide justification 

whole number placement 

borrow across zero 

minuend subtrahend exchange 

recopy subtrahend digits 
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S LEGEND 



O carry; k 

□ DECiMAL 

WHOLE NUMBER 

RIGHT JUSTIFICATION 6 
^ NO LEAD ZERO (WITH CARRY) 




FIGURE 3 : A Directed Graph of Addition Pre-Test 



/ 



17 



Op 



LEGEND 



P- VALUES. 
.80-1 ■ 



II 



.90- 



.95- 



4' 

Q 

□ 



lj.00i-> 



O CARRY 
□ DECIMAL 
^ WHOLE NUMBER . 
% RIGHT JUSTIFICATION 
^ *N0 LEAD ZERO (WITH CARRY) 

7? 




/ 



FIGURE 41 A Directed Graph of Addition Post -Test 
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difficulty associated with "set-up" (e.g. same number of digits to right 

# 

of decimal point) are easier for students while problems involving 
multiple difficulties are harder. This is indicated by the presence of 
the former items at the beginning^ chains and the location of the 
latter type at the end of the chains. . * 

The t directed graphs are constructed from chains (sequences) of 
items that demonstrate a dominance relationship. Specifically, the 
sequences for the addition pretest include: 
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5>12>?' ' 
5' >9'(or 1) 
H>11'>7'>9" 

>4'>9'(or 1') 

12' > 9' 
6>8'>9>9' 

>2>9' 

>3 

6'>8'>10'>9' 
7 > 9'(or 3') 
7' >9'(or I')' 
10>10'>9' . 

>,8>9>9' 
V >9'(or 1') „• 

3>r 

9>9' < 

The relationships of particular interest are those involving items 
for which predictions of dominance were made based on the content aomain 
relative skill table (page 13) T Support for a priori predictions were 
found for several of the items: 

2 > 9' (but not 1,2 > 9) 

/ 4 > 11,11' (.but not 4 > 7) 

9' > 8,8' 
9>8 

10, 10' > 8' > 6' (but not 10 > 5, 12) 

i ' i 

Jrt ^ relationships appear to be stronger for the items in the second 
^ftjij-f of the test (items are parallel to those in the first half). This 
may indicate that students tried several different strategies initially 
and only applied a strategy consistently after several items had been 
•answered. ■> 

~ The prediction of relative item difficulty was supported by the 
statistical analysis: 

19 



prediction actual 
1,2,3,4 (easi£cfr) 1,2,3, ,9 

T.0 (easy)* • 4 / ' • 

6, 7, §,n (difficult) 6,r;s,io 

5,8,12 ' (most difficult) 5*11,12 

The only item badly located by the p^edict^ion was item 9 vjiich was 

, f.\ * * 
easier than predicted* This mfey indicate /that the category "embedded 

zero** may not be* a common difficulty- and, as a result, way not 'need 

* • 1 / * 

equals weight with other, categories in predicting itea difficulty. 

The posttest prediction and actual results are similar: 

» +3f 

prediction * actual 
1,2,3,4 (easiest) 1,2^/4,9 

. 10 (easy?'*; -7- i * 

6, 7,, 9, 11- (dif^ult) 6,8,10 . 

5,8,12 (oos tl difficult) 5,11,12 

.. . ^ ■ +> 

The directed graph fox the second set of ifems on the subtractioc 
pre test is shown in Figure 5. The sequences of items which were used 

n 

to generate this graph include: 

7"">'3' > 10' > 5', 

/ . > 6' > 8' ■ 
9- > 6' > 8' 

; >y 

12' > 5' 

4'"> 11' . 
• />1' ' ■ . 

'f ' 
where the prime notation indicates *he item is from the second half o^ 

the test and tell* .its: item parallel. 



Insert Figure 5 about here 



The chains of particular interest e those involving items in .the 

a priori predictions (s^e page 16)* There is support tor most of the 

predictions. . Specif ically, v Ok 

5<12 (but not 5<2) 

1K4 \ 

6,8,10<7<3 (but not 7<3<9) 
- * <• 6,8<9 . 

* "K4" (but not 1<9) 
(and not 12<9) % 

' m Mojit of the predictions Which were not supported" involved item 9 

(20-004 - 0.CJ) which vas predicted to be relatively difficult,' but Was, 
in fact, only moderately difficult. 

• 20 



O BORROW ACROSS 0 (m s MULTIPLE BORROWS) 

□ DECIMAL 

^ WHOLE NUMBER 

^ DIGITS RIGHT OF DECIMAL NOV EQUAL 

^ MORE DIGITS IN SUBTRAHEND THAN MINUEND 

# ALL CATEGORIES ABOVE Y" / 



P-VALUES 
,60-i 



.70- 



.80- 



,90- 




.00 -J 



FIGURE S : A Directed Graph of Subtraction Pre-Test 
(second jet of items : 13 - 24 ) 



prediction t actual 

5 (easiest) 5 ' • 

2;6,8,10 (easy) 2,6,8,10,11, 

1,7,11,12 (moderate) 1,9,12 % 

3,9 (difficult) 3,7 

4 (most difficult) 4 

Posttest results reflect these same .relative item difficulty ratings. ^ 

Summary 

This report describes th£ application of item relational structure 

(IRS) analysis (a graph theoretic approach to Order analysis) to the 

construction of errot diag*stic tests (Tatsupka and Tatsuotca, 1981b) 

which can be used to desc/ibe specific misconceptions involved in 

addition and subtracriojr of decimal fractions. The IRS* analysis was 

compared with predictions of item dominance and relative item difficulty 

which were based jSn a content-domain relative skills analysis. 

Projected studen^ difficulties, identified with item characteristics 

pertinent to decimal fraction arithmetic such as "leading zeros in 

addends'* or "implicit decimals in whole' number subtrahends," suggested 

several item dominances. For example, students who 

could answer should be able to answer 

.032 + .06 .035 4* .062 

^_.54 + .83 0.53 + 0.81 

• 6 + .8 0.53 + 0.81 

.047 + 0.31 v .035 + .052 

TJie IRS analysis supports our item construction procedures in that 
it confirms the ^relative skills analysis of several iroporxant item 
charactersits including: digits to right of decim^ point, decimal 
notation, car: / across zero interacting with leading zeros (Sedition), 
number of digits to right of decimal point in subtrahend compared with 
number in minuend (subtraction). The IRS analysis did, however, 
indicate one characteristic that was not as important as predicted: 
zeros embedded in sum (difference) between decimal point and first non- 
zero digit to right of decimal point. There were also some questious 
raised about some item characteristic interactions and the construction 
of parallel items. 

There are two very critical questions which relate directly to this 
research. First, there remains an important question of how to use 
specific description of errors in designing effective and efficient 
remedial instruction. Second, to be practical, we must he able to 



22 



design our psychometric models so that they are easily and correctly 
used and interpreted by classroom instructors. 

The domain of decimal addition and subtraction is an attractive one 
to begin the development of classroom based error-didgnostic utilities 
since it is a managable size for initial efforts. It also offers an ■ 
opportunity to examine effective remediation directed at the conceptual 
level and remediation directed at the procedural leve 
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AppencLx I 
Addition and Subtraction Test 
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DECIHRL ADDITION TEST (PRE and POST) 



I • 


11 






H? + 1R = Sfl 

1 




L J 


1R ♦ W s fit 


L J 


iq x 9i; : .ill 

• 10 T aLU ~ mil 




J J 


lis J * JL. I - ID. 1 


J v J' 


It. I * J.L * Ij.O 


J, * 

*- 


U1 
"J 


ft CT x ft 01 - 1 1U 

U.bJ * U.ol - 1.4" 


— ■ — 1 JIM 


ft CU x A 10 - 1 QC 


7 

r 


S) 


H.32 ♦ 3 = 7.32 


5') 


S.HI ♦ 2 = 7.H1 . 


i 


6) 


.047 ♦ 0.31 = .357 


6') 


.036 ♦ O.Sl = .SH6 


I''- 

v: 


7) 


:SH ♦ .83 = 1.37 


7') 


.HS ♦ .92 = 1.37 


V 


8) 


.032 * .06 = .092 


8') 


.0H1 ♦ .05 = .091 




9) 


.035 ♦ .062 = .097 . 


' ' 9') 


.016 ♦ .023 = .039 


i' 


10) 


3.2H ♦ 6.5 = 9.7H 


10') 


2.34 ♦ 7.6 = 9.9H 




11) 


.6 ♦ .8 = 1.1 


ID 


.7 ♦ .9 = 1.6 


i 1 


. . 12) 


6 ♦ H.13 = 10.13 


- - 12') 


5 ♦ 3.2H r. 8.24 






1 







V 



/ 
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DECIHRL SUBTRflCTIOn /TEST (PRE and POST ) 



1) 


11.25 - 3.1 = 10.8S 


1') 


23.36 - 2.1 = 20.96 


2) 


1.1 - .8 = .6/"~ y ■" 


^ 2'), 1.6 - .9 = .7 


3) 


6.1 - 3.23S( = 3.16S 




5.7 - 2.S28 = 3.172 


V 


6 - 3.8 = 242 
.035 - .011 = .021 


. T) 


1 - 2.6 = 1.1 


5) 


5') 


.037 - .023 = .031 % 


6) 


.156 - 0.31 = .1% 


6') 


.832 - 0.71 = .122 


7) 


6.35 - 3.218 = 3.102 


7') 


5.63 - 2.527 = 3.103 


8) 


.576 - .23 = .316 


8') 


.659 - .3H = .319 


9) 


20.001 - 0.03 =.19.971 


9*) 


30.005 - O.OH = 29.965 


10) 


.631 - .3100 = .321 


10') 


.742 - .H200 = .322. 


11) 


8.7 - 5 = 3.7 


11') 


9.6 - 5 = H.6 


12) 


1.002 - .081 = 3.921 


12') 


5*003 - .072 = 1931 
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Appendix II 
Projected Errors for Addition and 
Subtraction of Decimals 
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Typical Errors'. in Addition of Decimals 

1. Right Justification: The student justifies the numbers along the 
right hand side and does not align the decimal points. For example, 
3.24 +6.5 becomes: 

3.2 4 
6.5 

3 8 9 (without decimal point) 

The decimal point may be placed corresponding to either addend or, in 
rare cases, in* both positions. Occasionally the ^tudent will omit the 
decimal point. Students may also use the "multiplication rule" for 
placing the decimal poiut. * ' 

2# Left Justification: Similar to right justification with the 

difference in' aligning numbers along the left hand side. 

For example, 3.24 + 6.5 becomes: 

3.2 4 
.6 5 

9 7 4 / 

Placement of the decimal point is described in 1 (above). 

j 

3. Inside-out justification: Students may use right justification for 

the whole nutnber portion and right justification for the decimal 

portion. For example* 3.24 + 6.5 becomes: 

3.2 4 
6. 5 



9.2 9 



The decimal point in 'the answer is usually correctly aligned (relative 
to the whole number). 

4. Whole number error: If the whole number does not have an explicit 
decimal point, students might write the decimal point to the left of the 
whole number. For example, 3 + 6.58 becomes: 



6.5 6 
_.3 
6.8 8 



Occasionally the whole nujnber is right justified with the decimal 
portion of the other addend (see #1). In this case, the decimal point 
of the answer usually corresponds to the explicit decimal point of the 
addend. For example, 3.+ 6.58 becomes: 



2 | 34 



ERLC 



5*5 8 

3 

6.6 1 



5. The carry, error: If the sum of the tenths digits involves a carry 
to the ones position, the answer is written as hundreds ius^eadv 

• 6 .45 
. 8 . 9 2 

• H .13 7 

This error usually occurs only if there- are no digits (zero or non-zero) 
written to the left of either decimal point. 

correct • correct incorrect 

0.6 0.6 .6 

0 » 8 «_8 . 8 

1*4 1.4 .14 

6. The lost zero: zeros written between the decimal point and the 

first non-zero digit to the right of the decimal point are omitted. 

.035 
.027* 
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7. Multiplication rule: The student places the decimal point in the 
answer by following the rule for multiplication. That is, the 
student adds the number of decimal places in the addends. For example, 
.35 + .86 becomes: v 



.35 
.86 



.0121 



8. Multiple decimal points: Student will include more than one decimal point. 
This usually occurs when the student does not align the problem correctly 

and has more than one column with an explicit decimal point. 

9. Missing decimal point: Student omits a necessary decimal point. 

Typical Errors in Subtraction* of Decimals 

1. Right Justification: Similiar to right justification in addition. 

2. Left Justification: Similar to left justification in addition. 

3. Inside-out justification: Similiar to additon. 

4. ^ Whole number error: Similiar to addition. 

5. The borrow error: Typical difficulty encountered in whole number 
subtraction. Another difficulty is encountered in decimal subtraction 

30 



in that some studeuts occasionally have difficulty borrowing across the 
decimal point often neglecting to adjust ^tha whole number portion of the 
decimal. • . 

6. The lost zero: Similiar to addition. 

7. Multiplication rule: Similiar to addition. 

8. Longer number error: The student assumes that the longer number is 
the larger and, as a result, it is written as the minuend. This of ten 
results in serious borrowing problems unless the^ student also right 
justifies the numbers. 

6.35 - 3.2 6.35 - 3.248 

6.3 5 3.2 4 8 

■ 3 - 2 6.3 ^ 

3' 1 5 2 6 1,3 

(without decimal point)" 

9. Recopying some digits from subtrahend: If the minuend has 
fewer digits to the right of the decimal than the subtrahend, 
some students will merely recopy' some of the subtrahend "digits 
without subtracting. 

6.4 




3.235 

This may be a carry over fjjrom addition in that the student may 
think that there is "nothijng to do." 

10. Multiple decimal points: Student will include more than one decimal poin 
This usually occurs when the student does not align the problem correctly 

and has more than one column with an explicit decimal point. 

11. Missing decimal point: Student omits a necessary decimal point. 
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Appendix III 
t 

Procedural Network Charts 
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CHART 3 




I 


1 


r 


> 




ADD COLUMN ENTRIES 
(INCLUDING "CARRIES") 
11 CARRYING "TO NEXT 
COLUMN IF NECESSARY. 



ADO NEXT 
COLUMN 
TO LEFT. 



COPY COLUMN ENTRY 
TO ANSWER COLUMN, 




FIGURE 6 : A Flowchart to Add Columns of Numbers 
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CHART 4 




3 

FIGURE 7 ." A Flowchart to Subtract Columns of Numbers 
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